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(54) Image sharpening and re-sampling method 

(57) Image processing method wherein an image is 
re-sampied and sharpened by subjecting the image to a 
convolution with a kernel the elements of which are 
determined by selecting a first set of kernel values so 



that a convolution of the image by means of a kernel 
with said first set of kernel values generates a sharp- 
ened image, and subsequently interpolating between 
the elements of this first kernel. 
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Description 

Reld of the invention 

5 [0001 1 The present invention relates to digital image processing. The invention more specifically relates to sharpening 
and resampling of medical images. 

State of tlie art 

10 [0002] In several medical imaging techniques, a visible image of an object under examination is generated by means 
of thermal reproduction techniques such as dry thermal printing. 

[0003] The sharpness of the r^roduced images, especially when they are reproduced on a transparent thermal sen- 
sitive medium is not always adequate for medical diagnosis. The images are considered un-sharp or not crispy 
[0004] The degree of un-sharpness experienced by the viewer, e.g. the physician or the radiologist may depend on 
15 the kind of image that has been reproduced, on the perceptibility of the viewer, on the characteristics of the image 
acquisition etc. ' ■ 

[0005] The un-sharpness (aiso referred to as smoothing) may be caused by thermal effects that have occuned in the 
thermal reproduction device such as heat distribution among the thermal elements of the thermal head part of the 
printer. It may also be caused by slow temperature increase and decrease of the heating elements in the thermal head. 
20 Although compensation for these effects is often provided, it may still not eliminate ait non-uniformities. 
[0006] Still other causes of inn-sharpness may occur. 

[0007] Furthermore, when images acquired by a digital image acquisition apparatus are reproduced, there is often a 
need for re-scaling of the pixel matrix. 

Images may need to be re-scaled for example because the pixel matrix of the acquired digital image does not match 
25 with the pixel matrix provided by a reproducing apparatus by means of which a hard copy of the digital image will be 
produced. 

Also lay-out requirements such as reproduction of a multiplicity of images on a single film (often applied in tomography), 
may demand for Image re-scaling. 

[0008] The above problems, i.e. sharpening and re-scaling, have been addressed separately in the prior art. 
30 [0009] Sharpening techniques are known according to which (a) digital spatial convolution f ilter(s) is (are) applied to 
the digital image. These digital spatial convolution filters used for image sharpening do not provide re-sampling nor 
image scaling. 

[0010] An example of such a technique is the unsharp masking technique wherein smoothing low pass filters such as 
mean filters. Gaussian filters etc. are used. 
35 [001 1 ] Another example consists of the application of a highpass filter such as the Laplacian or Gaussian filter. 
[001 2] In the prior art also image processing techniques are known which are based on a digital spatial interpolating 
convolution to be applied to images, e.g. scaled image, for creating intermediate pixels in between the pixels of the orig- 
inal pixel matrix of an image. 

[001 3] An example of such a technique is referred to as high resolution cubic spline interpolation. 
40 [0014] However, images often need to be re-scaled in addition to being sharpened, 

[0015] Application of the prior art methods requires both problems to be tackled separately i.e, one after the other. 
The prior art solutions hence are computationally expensive, they demand a lot of processing time and are hence not 
adapted for use in medical imaging where a physician wants to dispose of a hard copy image as soon as possible after 
examination in order to make a diagnosis. 

45 

Objects of the invention 

[0016] It is thus an object of the present invention to provide a method of sharpening and re-scaling an image that 
can be performed fast and that does not demand a lot of processing time. 
50 [0017] It is a further object to provide such a method that can easily be adapted to different kinds of images as well 
as to the user's taste. 

[0018] It is still a further object to provide such a method of sharpening and re-scaling that is adapted to the require- 
ments of medical imaging. 

[001 9] Further objects of the invention will become apparent from the description given below. 

55 

Summary of the invention 

[0020] The objects of the present invention are achieved by a method according to claim i . 
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[0021 ] The method of the present invention is applicable to Images provided by means of a digital signal representa- 
tion. 

[0022] Although the method was specifically developed for af^lication to medical images, it can be applied to all kinds 
of images that require image sharpening and for which varying image scaling or re-sampling is desired. 
5 [0023] The method can be implemented by software as well as by a mixed hardware-software embodiment 

[0024] The method provides a simple implementation of a combined image sharpening and image re-sampling tech- 
nique. 

in medical environments such as hospitals, physicians want to be able to make a diagnosis on a hand copy image as 
soon as possible after an examination. 
10 Care is thus taken to use a fast hard copy system such as the dry imaging system and to use a fast working image 
processing system such as the processing of the present invention which is computationally less expensive than the 
prior art techniques. It provides enhanced images in fast and accurate way and is thi^ very well suited for use in a med- 
ical environment. 

[0025] The method of ttie present invention does not Introduce unwanted artefacts ag. due to aliasing, overshoots, 
IS contouring etc. Consequentially it does not have any negative influence on the diagnosis. 
[0026] The method of the invention makes use of either a one or a two-dimensional kernel. 
[0027] When a two-dimensional kernel is used, the image can be filtered in a single pass, whereas the use of one- 
dimensional kernels implies two passes, one for a first, e.g. horizontal filtering and one for a second, e.g. vertical filtering 
of a two-dimensional image. 

20 ^ [0028] In a prefen-ed embodiment (down-loadable) convolution tables are used so that the image processing charac- 
teristics can be easily adapted to different kinds of images or to the taste of the user. 

[0029] According to the invention the kernel elements are obtained by selecting a first set of kernel values so that a 
convolution of the image by means of a kernel with said first set of kernel values generates a sharpened image and 
interpolating between kernel values of the first set. 
25 [0030] The interpolation preferably is based on a third order function. Preferably a cubic spline interpolation between 
the values of the first kernel is used such that a desired interpolation function is approximated. 
The desired interpolation function Is preferably a sin x /x function. 

[0031] In order to be able to obtain said approximation, the following constraints must be applied: 

30 - in case of a scaling factor equal to 1/1 the sharpening kernel values need to be used (values of the first kernel), 
the interpolation function must be symmetric around the center point of the kernel, 
the slope in the center point is zero, 
the function is continuous in alt points, 

the slope of a spline in the end point of a spline should be equal to the slope in the start point of an adjacent spline. 

35 

[0032] Other interpolation techniques can be use such as linear interpolation (with triangular function) etc. 
However, cubic spline approximation is preferred because it does not introduce undesired effects which could have a 
negative influence on the diagnosis. 

40 Brief description of the drawings 

[0033] The present invention will now be described, by way of example, with reference to the drawings, in which : 

Rg. 1 is an overall block diagram illustrating operational elements of a thermal printer wherein the present invention 
45 can be applied. 

Rg. 2 illustrates the composition and the operation of a signal processing unit wherein the method of the present 
invention is performed, 

50 Fig. 3 is a graphical representation of a pure sin x / x function and the interpolation points (for half a kernel) 
Detailed description 

[0034] In the block diagram of figure 1 the different operational blocks of a thermal printer for reproducing a medical 
55 image provided as a digital signal representation, are shown. 

[0035] The thermal printer comprises four main blocks: a thermal print head indicated by numeral 1, print engine 
mechanics indicated by numeral 2, a print engine 3 and a controller 4. 

[0036] Print engine mechanics 2 provide the movement of the thermal head 1 relative to a reproducing material. 
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[0037] Controller 4 controls the image acquisition, the image composition and the Image processing. In this example 
controller 4 is a medical gateway controller that accepts different inputs. 

[0038] An image to be printed can be fed to the medical gateway controller by two ways. Either the digital image rep- 
resentation is fed via network input 5 or via point-to-point inputs 6. 

5 [0039] Point-to-point inputs are connections with single external image acquisition apparatus such as CT apparatus, 
US apparatus etc. In the described example four such inputs are provided, the inputs can take analog or digital image 
input. The point-to-point inputs are connected to image acquisition section 7 part of medical gateway controller 4. 
[0040] Images input via acquisition section 7 or via network input 5 are buffered in buffer section 8 and further applied 
to composition and image processing section 9. 

10 [0041 ] In image processing section 9 a desired lay-out is generated and the image processing according to this inven- 
tion, i.e. combined scaling and interpolation, is performed. 

[0042] For this purpose the image is twice convoluted by means of a convolution kernel, the elements of which are 
determined following the method described furtheron. 

For the secorxi convolution the image is rotated by 90 degrees relative to its position when bein convoluted a first time. 
15 [0043] The processed image is then applied to the print engine 3. Print engine 3 comprises an image compensation 
section 10 and a print engine control section 1 1 . 

[0044] Connpensations such as neighbour compensation performed in image compensation section 10 have been 
described in e.g. in European patent application-A-627 319. 

[0045] Also commands necessary for film handling in the printer are generated in print engine control 1 1 . 
20 [0046] The image processing in image processing unit 9 is mainly executed by hard-ware. The hardware image 
processing accelerator circuit is in the following denoted by HIP (hardware image processor). 
[0047] Figure 2 schematically shows the composition of the HIR 

[0048] The HIP basically comprises an input line buffer 12, status and control registers 1 3. an image scaling and inter- 
polation sequencer 14, and an output line buffer 15. 
25 [0049] The status and control register 13 and the input buffer 12 and output buffer 15 of the HIP are mapped into the 
memory map of an embedded computer. 

[0050] The input and output buffers are organized as first in, first out buffers (FIFO). 

[0051] The control registers allow the setting of a number of parameters such as the number of pixels per line in a 
reproduced image, the convolution values, the zoom ratio etc. 
30 [0052] The system works on an image line basis, the number of pixels per line (input and output) is programnrable. 
[0053] In sequencer 14 the data stream between the input and the output FIFO (first in, first out) buffers is handled. 
The sequencer converts data stored in the input FIFO line buffer to a serial pixel stream at the required resolution. 
The data are then written into the output FIFO line buffer. 

The ratio between the input and the output clock depends on the interpolation (scaling) factor. 
35 [0054] According to the present invention the scaling and interpolation is performed with a single programmable con- 
volution kernel which in this embodiment comprises 8 x 16 values. 
The distance between each input pixel is divided into 15 subsample points. 
[0055] The operation of the sequencer is basically as follows. 

The sequencer is first initialized by filling in the parameters such as line length, zoom ratio, convolution coefficients. 
40 The operation of the sequencer is then started. 

When the external input line buffer is filled, the sequencer will start to read input lines, calculate new pixel values by 

applying the method of the present invention and store the results in the output buffer. 

This process continues until the input buffer is enpty and the output buffer is filled. 

This status change can be monitored by the processor. 
45 [0056] The sequencer will resume operation as soon as the input buffer us full again and the output buffer is empty. 

In this way, the interpolation sequence will be ended at the end of the last line of the image when the input buffer isn't 

filled anymore. 

[0057] In order to perform the innage processing according to the invention, the image is passed twice through the HIP 
The first time scaling and interpolation is performed in a first direction, e.g. horizontal direction in the image. 
50 During the second time, the image is rotated by 90 degrees and fed to the HIP so as to result in vertical scaling and 
interpolation. 

[0058] When the two-dimensional process is split in a horizontal and a vertical pass, a one dimensional convolution 
vector is required. 

[0059] In this example the convolution vector comprises 8x16 values that are calculated as follows: 

55 

first a set of 8 kernel values is determined that provides image sharpening when being applied to the image, 
next interpolation between the values of the so-called first set is performed. 
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[0060] The following example will illustrate this method. 
(0061 ] The original image vector is V^rg = (00001 000). 
The mean smooth vector is: 

Vsmooth = (0.125 0.125 0.125 0.125 0.125 0.125 0.125 0.125) 
5 Factor: k = 0.75 

The values defined by the sharpening filter are defined by Vgharp- Sharpening image vector is then equal to : 
Vsharp = (-0.094 - 0.094 -0.094 -0.094 1 ,656 -0.094 -0.094 -0.094) 

The interpolation values are obtained by drawing a sin x /x like function through the 8 values by cut»c spline approxima- 
tion. 

10 [0062] It is to be noted that because of the symmetry only 4 segments have to be calculated. 



* first segment, interval 0 . . 1 


y1 = a1.x^+b1.x2+cl.x+d1 




dl =vO 


value for X = 0 


c1 =0 


slope is 0 for X = 0 


al+bl+cl+dl = v1 


value for X = 1 


6.1.a1+2.b1 =0 


bendpoint for x = 1 
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second segment, ifrterval 1 . . 2 


y2 = a2.x^+b2.x^-K:2.x+d2 




a2+b2+c2-Ki2 = v1 


value for X = 1 


3.a1 .1 ^+2.b1 .1+cl = 3.2.1 ^ 1+2.b2.1 4C2 






slope of 2 segments equal 




atx= 1 


a2.2^+b2,2^-K;2.2+d2 = v2 


value for X 2 


6.2.a2+2.b2 = 0 


bendpoint for x = 2 
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* third segment, interval 2 . . 3 


y3 = a3.x^+b3.x^+c3.2+d3 = v2 




a3.2 ^+b3.2 ^+c3.2+d3 = v2 


value for X r: 2 


(3.a3.2^+2.b3.2+c3).A = 3.a2.2 ^+2.b2+c2 






slope of 2 segments equal 




atx = 2 


a3.3^+b3.3^+c3.3+d3 = v3 


value for X = 3 


6.3.a3+2.b3 = 0 


bendpoint for x = 3 
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* fourth segment, interval 3 . . 4 


y4 = a4.x^+b4.x^+c4,x+d4 




a4.3 ^+b4.3 ^+c4.3+d4 = v3 


value for X = 3 


3.a3.3^+2.b3.3+c3 = 3.a4.3 ^+2b4.3+c4 






slope of 2 segments equal 




atx = 3 


a4.4^+b4.4^+c4.4+d4 = 0 


value for X = 4 


3.a4.4^+2.b4.4+c4 = 0 


slope is 0 for X = 4 
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* interpolating points for half of the kernel 


vo=1.656 


v1 =-0.094 


v2= -0.094 


v3=-0.094 


segment 1 


segment 2 


segment 3 


segment 4 


1.656 


-0.094 


-0.094 


-0.094 


1.646 


-0.243 


■0.019 


■0.129 


1.617 


-0.363 


0.041 


-0.153 


1.569 


-0.456 


0.087 


-0.167 


1.506 


-0.525 


0.121 


-0.172 


1.426 


-0.57 


0.144 


-0.169 


1.333 


-0.594 


0.156 


-0.16 


1.227 


-0.599 


ai58 


-0.147 


1.109 


-0.586 


0.152 


-0.129 


0.981 


-0.558 


0.138 


■0.109 


0.844 


-0.517 


0.117 


-0.087 


0.7 


-0.464 


0.091 


-0.066 


0.549 


-0.402 


0.06 


-0-045 


0.392 


-0-331 


0.025 


•0-027 


0.232 


-0.255 


0.013 


-0.013 


0.07 


-0.176 


0.053 


0 



50 [0063] Figure 3 shows a pure sin x/x function as well as the interpolation points for half of the kernel, (kernel values 
fo different segments) obtained by applying the method of the present invention. 

Claims 

55 1 . Image processing method wherein an image is re-sampled and sharpened characterized in that said image is sub- 
jected to convolution with a discrete and finite convolution kernel having kernel elements selected so as to produce 
simultaneously resampling and sharpening. 
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2. An image processing method according to claim 1 wherein said kemel elements are obtained by the steps of 

- selecting a first set of kemel values so that a convolution of the in^ge by means of a kernel with said first set 
of kernel values generates a sharpened image. 
5 • interpolating between kernel values of the first set. 

3. An image processing method according to daim 2 wherein interpolation is performed by drawing an interpolation 
function through the elements of said first set. 

10 4. An image processing method according to daim 3 wherein interpolation is performed by applying cubic spline 
approximation of said interpolation function through the elements of said first kernel. 

5. An image processing method according to claim 3 wherein said interpolation function is a sin x / x function. 

15 6. An image processing method according to daim 1 wherein said kerne! elements are stored in a convolution look 
up table. 

7. An image processing method according to claim 1 wherein said convolution kernel is a one-dimensional kernel and 
said image is twice subjected to said convolution, a second time being rotated by 90 degrees relative to a first time. 
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